Local Competition and Stochasticity for Adversarial Robustness in Deep Learning

This work addresses adversarial robustness in deep learning by considering deep networks with stochastic local winner-takes-all (LWTA) activations. This type of network units result in sparse representations from each model layer, as the units are organized in blocks where only one unit generates a non-zero output. The main operating principle of the introduced units lies on stochastic arguments, as the network performs posterior sampling over competing units to select the winner. We combine these LWTA arguments with tools from the field of Bayesian non-parametrics, specifically the stick-breaking construction of the Indian Buffet Process, to allow for inferring the sub-part of each layer that is essential for modeling the data at hand. Then, inference is performed by means of stochastic variational Bayes. We perform a thorough experimental evaluation of our model using benchmark datasets. As we show, our method achieves high robustness to adversarial perturbations, with state-of-the-art performance in powerful adversarial attack schemes.Comment: Accepted AISTATS 2021. arXiv admin note: text overlap with arXiv:2006.1062

CASAM: Collaborative Human-machine Annotation of Multimedia.

The CASAM multimedia annotation system implements a model of cooperative annotation between a human annotator and automated components. The aim is that they work asynchronously but together. The system focuses upon the areas where automated recognition and reasoning are most effective and the user is able to work in the areas where their unique skills are required. The system’s reasoning is influenced by the annotations provided by the user and, similarly, the user can see the system’s work and modify and, implicitly, direct it. The CASAM system interacts with the user by providing a window onto the current state of annotation, and by generating requests for information which are important for the final annotation or to constrain its reasoning. The user can modify the annotation, respond to requests and also add their own annotations. The objective is that the human annotator’s time is used more effectively and that the result is an annotation that is both of higher quality and produced more quickly. This can be especially important in circumstances where the annotator has a very restricted amount of time in which to annotate the document. In this paper we describe our prototype system. We expand upon the techniques used for automatically analysing the multimedia document, for reasoning over the annotations generated and for the generation of an effective interaction with the end-user. We also present the results of evaluations undertaken with media professionals in order to validate the approach and gain feedback to drive further research

Historical Mammal Extinction on Christmas Island (Indian Ocean) Correlates with Introduced Infectious Disease

It is now widely accepted that novel infectious disease can be a leading cause of serious population decline and even outright extinction in some invertebrate and vertebrate groups (e.g., amphibians). In the case of mammals, however, there are still no well-corroborated instances of such diseases having caused or significantly contributed to the complete collapse of species. A case in point is the extinction of the endemic Christmas Island rat (Rattus macleari): although it has been argued that its disappearance ca. AD 1900 may have been partly or wholly caused by a pathogenic trypanosome carried by fleas hosted on recently-introduced black rats (Rattus rattus), no decisive evidence for this scenario has ever been adduced. Using ancient DNA methods on samples from museum specimens of these rodents collected during the extinction window (AD 1888–1908), we were able to resolve unambiguously sequence evidence of murid trypanosomes in both endemic and invasive rats. Importantly, endemic rats collected prior to the introduction of black rats were devoid of trypanosome signal. Hybridization between endemic and black rats was also previously hypothesized, but we found no evidence of this in examined specimens, and conclude that hybridization cannot account for the disappearance of the endemic species. This is the first molecular evidence for a pathogen emerging in a naïve mammal species immediately prior to its final collapse

Host tropism determination by convergent evolution of immunological evasion in the Lyme disease system

Pathogens possess the ability to adapt and survive in some host species but not in others-an ecological trait known as host tropism. Transmitted through ticks and carried mainly by mammals and birds, the Lyme disease (LD) bacterium is a well-suited model to study such tropism. Three main causative agents of LD, Borrelia burgdorferi, B. afzelii, and B. garinii, vary in host ranges through mechanisms eluding characterization. By feeding ticks infected with different Borrelia species, utilizing feeding chambers and live mice and quail, we found species-level differences in bacterial transmission. These differences localize on the tick blood meal, and specifically complement, a defense in vertebrate blood, and a polymorphic bacterial protein, CspA, which inactivates complement by binding to a host complement inhibitor, Factor H (FH). CspA selectively confers bacterial transmission to vertebrates that produce FH capable of allele-specific recognition. CspA is the only member of the Pfam54 gene family to exhibit host-specific FH-binding. Phylogenetic analyses revealed convergent evolution as the driver of such uniqueness, and that FH-binding likely emerged during the last glacial maximum. Our results identify a determinant of host tropism in Lyme disease infection, thus defining an evolutionary mechanism that shapes host-pathogen associations

Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts

Sifting through vast textual data and summarizing key information imposes a substantial burden on how clinicians allocate their time. Although large language models (LLMs) have shown immense promise in natural language processing (NLP) tasks, their efficacy across diverse clinical summarization tasks has not yet been rigorously examined. In this work, we employ domain adaptation methods on eight LLMs, spanning six datasets and four distinct summarization tasks: radiology reports, patient questions, progress notes, and doctor-patient dialogue. Our thorough quantitative assessment reveals trade-offs between models and adaptation methods in addition to instances where recent advances in LLMs may not lead to improved results. Further, in a clinical reader study with six physicians, we depict that summaries from the best adapted LLM are preferable to human summaries in terms of completeness and correctness. Our ensuing qualitative analysis delineates mutual challenges faced by both LLMs and human experts. Lastly, we correlate traditional quantitative NLP metrics with reader study scores to enhance our understanding of how these metrics align with physician preferences. Our research marks the first evidence of LLMs outperforming human experts in clinical text summarization across multiple tasks. This implies that integrating LLMs into clinical workflows could alleviate documentation burden, empowering clinicians to focus more on personalized patient care and other irreplaceable human aspects of medicine.Comment: 23 pages, 22 figure

Host tropism determination by convergent evolution of immunological evasion in the Lyme disease system [preprint]

Microparasites selectively adapt in some hosts, known as host tropism. Transmitted through ticks and carried mainly by mammals and birds, the Lyme disease (LD) bacterium is a well-suited model to study such tropism. LD bacteria species vary in host ranges through mechanisms eluding characterization. By feeding ticks infected with different LD bacteria species, utilizing feeding chambers and live mice and quail, we found species-level differences of bacterial transmission. These differences localize on the tick blood meal, and complement, a defense in vertebrate blood, and a bacterial polymorphic protein, CspA, which inactivates complement by binding to a host complement inhibitor, FH. CspA selectively confers bacterial transmission to vertebrates that produce FH capable of allele-specific recognition. Phylogenetic analyses revealed convergent evolution as the driver of such findings, which likely emerged during the last glacial maximum. Our results identify LD bacterial determinants of host tropism, defining an evolutionary mechanism that shapes host-microparasite associations

Population Genetics of Franciscana Dolphins (Pontoporia blainvillei): Introducing a New Population from the Southern Edge of Their Distribution

Due to anthropogenic factors, the franciscana dolphin, Pontoporia blainvillei, is the most threatened small cetacean on the Atlantic coast of South America. Four Franciscana Management Areas have been proposed: Espiritu Santo to Rio de Janeiro (FMA I), São Paulo to Santa Catarina (FMA II), Rio Grande do Sul to Uruguay (FMA III), and Argentina (FMA IV). Further genetic studies distinguished additional populations within these FMAs. We analyzed the population structure, phylogeography, and demographic history in the southernmost portion of the species range. From the analysis of mitochondrial DNA control region sequences, 5 novel haplotypes were found, totalizing 60 haplotypes for the entire distribution range. The haplotype network did not show an apparent phylogeographical signal for the southern FMAs. Two populations were identified: Monte Hermoso (MH) and Necochea (NC)+Claromecó (CL)+Río Negro (RN). The low levels of genetic variability, the relative constant size over time, and the low levels of gene flow may indicate that MH has been colonized by a few maternal lineages and became isolated from geographically close populations. The apparent increase in NC+CL+RN size would be consistent with the higher genetic variability found, since genetic diversity is generally higher in older and expanding populations. Additionally, RN may have experienced a recent split from CL and NC; current high levels of gene flow may be occurring between the latter ones. FMA IV would comprise four franciscana dolphin populations: Samborombón West+Samborombón South, Cabo San Antonio+Buenos Aires East, NC+CL+Buenos Aires Southwest+RN and MH. Results achieved in this study need to be taken into account in order to ensure the long-term survival of the species.Fil: Gariboldi, María Constanza. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad Maimónides. Área de Investigaciones Biomédicas y Biotecnológicas. Centro de Estudios Biomédicos, Biotecnológicos, Ambientales y de Diagnóstico; ArgentinaFil: Tunez, Juan Ignacio. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad Nacional de Luján; ArgentinaFil: Dejean, Cristina Beatriz. Universidad Maimónides. Área de Investigaciones Biomédicas y Biotecnológicas. Centro de Estudios Biomédicos, Biotecnológicos, Ambientales y de Diagnóstico; Argentina. Universidad de Buenos Aires. Facultad de Filosofía y Letras. Instituto de Ciencias Antropológicas. Sección Antropología Biológica; ArgentinaFil: Failla, Mauricio. Fundación Cethus; ArgentinaFil: Vitullo, Alfredo Daniel. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad Maimónides. Área de Investigaciones Biomédicas y Biotecnológicas. Centro de Estudios Biomédicos, Biotecnológicos, Ambientales y de Diagnóstico; ArgentinaFil: Negri, Maria Fernanda. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Parque Centenario. Museo Argentino de Ciencias Naturales ; ArgentinaFil: Cappozzo, Humberto Luis. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad Maimónides. Área de Investigaciones Biomédicas y Biotecnológicas. Centro de Estudios Biomédicos, Biotecnológicos, Ambientales y de Diagnóstico; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Parque Centenario. Museo Argentino de Ciencias Naturales ; Argentin

Genetic Evidence Highlights Potential Impacts of By-Catch to Cetaceans

Incidental entanglement in fishing gear is arguably the most serious threat to many populations of small cetaceans, judging by the alarming number of captured animals. However, other aspects of this threat, such as the potential capture of mother-offspring pairs or reproductive pairs, could be equally or even more significant but have rarely been evaluated. Using a combination of demographic and genetic data we provide evidence that i) Franciscana dolphin pairs that are potentially reproductive and mother-offspring pairs form temporal bonds, and ii) are entangled simultaneously. Our results highlight potential demographic and genetic impacts of by-catch to cetacean populations: the joint entanglement of mother-offspring or reproductive pairs, compared to random individuals, might exacerbate the demographic consequences of by-catch, and the loss of groups of relatives means that significant components of genetic diversity could be lost together. Given the social nature of many odontocetes (toothed cetaceans), we suggest that these potential impacts could be rather general to the group and therefore by-catch could be more detrimental than previously considered

GLADX: An Automated Approach to Analyze the Lineage-Specific Loss and Pseudogenization of Genes

A well-established ancestral gene can usually be found, in one or multiple copies, in different descendant species. Sometimes during the course of evolution, all the representatives of a well-established ancestral gene disappear in specific lineages; such gene losses may occur in the genome by deletion of a DNA fragment or by pseudogenization. The loss of an entire gene family in a given lineage may reflect an important phenomenon, and could be due either to adaptation, or to a relaxation of selection that leads to neutral evolution. Therefore, the lineage-specific gene loss analyses are important to improve the understanding of the evolutionary history of genes and genomes. In order to perform this kind of study from the increasing number of complete genome sequences available, we developed a unique new software module called GLADX in the DAGOBAH framework, based on a comparative genomic approach. The software is able to automatically detect, for all the species of a phylum, the presence/absence of a representative of a well-established ancestral gene, and by systematic steps of re-annotation, confirm losses, detect and analyze pseudogenes and find novel genes. The approach is based on the use of highly reliable gene phylogenies, of protein predictions and on the analysis of genomic mutations. All the evidence associated to evolutionary approach provides accurate information for building an overall view of the evolution of a given gene in a selected phylum. The reliability of GLADX has been successfully tested on a benchmark analysis of 14 reported cases. It is the first tool that is able to fully automatically study the lineage-specific losses and pseudogenizations. GLADX is available at http://ioda.univ-provence.fr/IodaSite/gladx/